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. \ questionnaire provided the mo^ meaningful, useful inf oi^fl^tio^^ 
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Abstract 



n selfir • 

if . 
/ 



Published tests are usually co^^dered to be mo 

Jv^eloped measures for conducting career education needs assessments 
is paper compare3 the merits of these two /types of instrumfentsv using 

ucatYon, It 
are 



^data from a recently 'doncttJcted neejds assessment in 
is concluded that while published instruments can be 
not the most appropriate choice for many needs asse 
developed measures hav.e" the potenl?^l of prQviding .buch us^ul infor- 
mation and should be, a moPe frequent method of choice injjfoing pareer 
education needs -assessmeints — as aa. addition to or a ^pstitute for > 



published. measures • 
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/- • ^ . NEEDS ASSESSMENTS IN CAREER EDUCATION: 

. ALTERNATIVES TO PUBLISHED TESTS 4 

Before a new educational program is designed or i&plement^ed^ it is 
,gssential that the needs, of the taTget population be assessed (Klein, 

: ' ' ^ ' ^ '\ ' - ^ • - 

Fenstermacher aiic^ AJ.kin, '1971; Stuff lebeam, Foley, Geph^rt, Guba, Hammond, 

» * _^ > 

Merriman and Provus, 1971; 'Gallagher , Surles and Hayes, 1973)- ThTs 

tfeeds assessment should provide information tha^ can be useST by both 

administrators and program developers. As, a* result' of the. needs asseiss- 

ment, administra.tors should -be in a better position to d^teAiine whether 

or not a ^program is warrante*d. The needs assessment data should provide 

program developers with insights regarding the nature of.the^area and 

possible* intervention strategies. vQbviousiy, most needs, as^es-sments 

will Jiot prescribe a detailed training. program* or instructional system;^ 

ft • 
but, a properly designed and effectively executed needs assessment , ' 

^ should; provide system designers with a set of intervention iddas that 

» \ , * * « ^ 

.otherwise would not have been available. * * 

During the ^st decade there has be^n a gr^at deal of emphasis 

placed on career education and guidance programs . (Bell and Hoyt,.1974; 

USOE,' 1975; Hoyt, 1975). Career education funding, progr^ms^ curricula 

and research have increased dijkmatically (ERIC's Research in Education 

Index list-s SZ entries in the , area of Career. Education ^nd Guida^e in 

,1968 and more than 1000 references, in 1976).. As this emphasis. xrontinues 

it is critical that more careful attention be directed to the instruments 

and methodologies employed by educators in the assessoleht of student's 
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career guidance needs. One of the most basic considerations in conduct- 
ing any needs assessment is the selection of appr'opriate measurement 
tools. Du^ring this selection process evailuators must determine whether 
to use published tests or to develop new, instruments and evaluation 
techniques. The purpose of this paper is to weigh the benefits' of each 
of, those alternatives. Data- will be presented from a recently condj^cted 
. career educatioi) needs assessment which will. illustrate the merits^of 



self-develbped tests vs. published tests. 



Assessment Alteraatives in Id&ntifying Needs 
'' ' i 

' . ^ - ; 

Evaluators and school administrators often choose to administer 
published instruments rather than <^veloping new^ asisessment tools. The 
advantages of published tests which ara probably responsible for such 
frequent selection are impressive i 

1. Published rtistruments. are readily available. In^rument 

\-' . ' ■ ' 

development can be a time-consuming arid costly endeavor while 
the cb^t associate^ with ordering a previously published 
instrument is almost always reasonable. The overall ^avings^ 
in time and money are undediable. 

2. Published instruments are convenient andoCasy to use. They . 
come complete with instructions and scoring procedures. Many 
companies will provide a scoring service *for a nominal charge. 
With only a few hours of work, the results can^be ready for 
interpretation. Some companies even offer individual diaj- 
nostics and aid in 1^ interpretation of results. 
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i ■ 

3- The results, of pablishe^d tests have a credibility that' self-' 
. 'developed instruments often lack; Most publishe(feiests have ' 
^ heep developed by' professionals over a number^ of years and 
have been used extensively. 

t 

In spite of these advantages, the decision to use a published test 
instead of a self-developed measure should not Be, an automatic reaction 
whenever a needs assessment isibeing planned* Frequently a self-devel- 
oped measure will .provide more useful information than the b^st available 
published test. This is not because the previously mentioned advantages 
of published tests are untrU'e, but gather,, because, these advantages can 
be outweighed'* by a single disadvantage - published tests do not always 
meet the unique information needs of the particular circumstance. »/ 

/ The intent of that statement is not to villanize publishing compa- 
nies or to imply that they have secretly conspired to increase their 
•profits by convincing, an unsuspecting public of fabricated advantages. 
The advantages in using published .tests are w^l documented. But few 
publishing companies of authors would claim that theit tests do all of 

the things for which 'people sometimes use them. When published tests 

* • 
are used for other purposes than those for which they were specifically 

developed, it is not surprising that the utility and meaningfulness of 

V . J 

the results, decline; The farther the actual use is removed from the use^ 
for which the test* was intended and developed, the' less meaningful the, 
results* r ' ^ ' * 

k > « 

.* The' choice to'use a published instrument, or one that is self-devel- 
oped, or- some combination should depend- on. severaj. criteria: a) ^a 
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Carefi^l analyses of the uniqile types of infbrmation needed; 2) a compar- i 
.< " ' ' ' • . • : 

ison o| those needs with the information which can be provided by *each i 

alternative test; 3) a consideration. of how much time and expertise is 

available for test development; and, 4) an underst.anding that it is .rK)t 

necessary to be highly trained in psychometric? in order to gather 

useful infQnnation in a reason^able ampunt of^time. Considering these 

factors, self-developed measures will frequently' be a method of choice* 

in conducting carejer education' and guidance needs asseSfesments — eithet 

as a replacement or a supplement fpr other published measures.' The 

advantages which can come from the use of .sfelf-develbped measures can be 

■ : ■ . 

seen by examining an actual needs^assessment study c6nduj:ted. by the 
authors in which both types of measures were used. 

A Career Education Neecis Asse§fement 



In the fall of 1976, a suburban school district in upstate New York 

/ *' 
was conce-rned about upgrading their career education program for graWes 

9-12. Before commencing a major effort of program development, the 

district's school board and central administration requested that a 

needs assessient be conducted to determine the extent a^id nature. of the 

need for an expanded effort in the area. Si^xty-four 9th grade students 

*and forty- four 12th grade students i^ere .chosen to be representatives of 

the district's population and asked to participate" in the^needs assess-^ 

ment. The students were given a widely used published measure of career 

maturity. " In addition, each of the students and .their parents reapondeid 

to a short* questionnaire *which was deVfelopeJ specifically forthe project. 
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Results of the Published Instrument 

V- 



Each of the studeats completed the attitudes section of the fareer 



Maturity Inventory (CMI, Crites^ 1973). This part of 'the CMI isN^^ne of 
the most widely used measures of * career matu'i'ity. It is easily obtain- 
able, reasonably priced, convenient to use, and comes complete with 

/ . , . ... 

administration and scoring instructions, national norms, and ai^ optional 

m 

scoring service from the publisher. Becausex^ its wide ijse, it has a 
high degree of credi-bilit!y altoong most educators.. Since it had been used 
in other similar situations, it was a logical choice as a .way of assess- 
ing how much need there was among the dis trict' s students for an expanded 
or revised effort in career education and guidance. 



Insert table 1 about here^ 



.According to the results shown in Table 1, the average student in 
this school district is slightly more mature about making career deci- ^ 
sions than is the aver.a^e person of compaTable^ grade 'level in the United "^^ 

States. The item level data gives more specific iofortaation. As can be 

* • • 

seen almost aJJ^ students thipk that job. choice ought to be consistent 

with a person's beliefs, is not an accidental occurrence and that thepe 

are multiple appropriate jobs for any one person. ' Substantial numbers 

of students think that work is of worth mostly for what it allows a 

person to* buy. About 1/4 to l/<8 of - the stiidents seldom think about a* ' 

future occupation and about the same niynber of students frequently 

change 'their, occupational choice/ ^ \ ^ , . ' 
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How liseful are thes^ results for the district? One interpretation 



ds*-that the average student in the district needs suppleinj^ntal ^career 

education' and guidance slightly less* than the average s^ufa^t*in the 

/ / 

nation. If we examine the individual questions in hppes of finding 
substantial, subgroups of students who have partip^'ar needs, we fiftd 
little 'additional information. Neither th^ decisions-makers nor the • 
program designers have the type of ' information they neej^. If the'^dis- 
' trict had been dependent only on the £MI as a needs assessment tool, at 
best they would know little more at the endi than they did at the begin- 
ning. At worst, they. might incorrectly conclude that since the district's 
average score in career maturity was higher than the national average. 



.career education knd guidance should not be a piriority in the district. 
\ Re'sult& of a Self-Developed Questionnaire ^ 

The second pari of the needs assessment* consisted of a questionnaire 

whicli bad been deyftiLoped within the district. This questionnaire was 

» i * * ' 

administered to the| same Students who had taken the'CMI. Additionally, 

the parents of those students ,wej:e a^ked to respond to a telephone- 

interview jconsistlng of questions which,.were parallel ta the ones com- 

ple^d by the students. The questions, as they were asked to, parents 

are shown in Table II • ^ . " ' \ 

Insert Table 2 about here » 



The answers to these questions by both parents and. students can be 
broken into two broad .categorioP: 1) parental influence on career 
decisions; and, 2) 'school influence in c'^reer decisions. . 
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Pa rental^ influence on career decisio^ ^ 

» ' ** 

. Approximate_ly.:two-thirds of 9th and 12th grade students and 'their 
parents felt that "some*^ or lot" of ^parental influence was appropriate 
in makiHg cireer decisions. More thaii.90% of tke respondents agrefed 
that most of the career related^^teraction between parents and childrlsn 
which is now occurring is spontaneous instead ^of planned. Although most 
parents vJere unawar^fe of ciljirrent community or school ri^ources, three- 
quarters of them said theyi would be interested in/participating if the 
school were to provide prograips for aiding parent* in career counseling. 

The data also show that 'parents and students disagree to -a signifi- 
cant extent about the amoiiiyt and usefulness of interaction and hxiw well 
informed the parent is abj/ut career counseling*. The average parent 
estimated that 13 hour^/vas* §pent during the last year talking wi^ the 
student about what t^ sXudenC was going to do following graduation from 
#high school. The Average student estimated less than one-fourth this 
j^i^ time (3 hours). Approximately 25% of the 12th grade students think 
that their parents are not very well infoj::ai€?[ regarding career education 
and that- conversations with their, parents are not very useful. Addi- 
tionally, as the students progress fi:om 9th to 12th grade, the parents 



t 9 

see themselves becoming better informed and the conversations^ becoming 
* mo're useful, while students see xheir parents becoming less w«41 informed 
aAd th'fe conversations -becoming less useful. Also, students who view 
their pacents as being well informed ^re rtuch more likely to talk with- 
their parents about ^career related decisions. Thirty-nine percent of 
the parents of 9th graders and 13% of the parents of 12th graders disagreed 
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with thei-r' child about whether he was planning ^fo go to work; or c6ntinue ^ 

A. » . V 

his schooling following graduation from high school. 

These data suggest a number 6f things about the influence of parents 
on the career decision making process of their children. First, parentsT 
and students agree that there is a need for more parental influence in 
career education. But, significant disagreement exists, abput the amount 
and usefulness, of the present interaction as w^ll as the quality of the 
parents' information. These data indicate a lack of understanding as 
well as miscpmmunication between parents and their children about what 
career education involves, what the students need to know and what 
experiences the students have already had. Xhese problems are compounded 
by the spontaneous nature of the majority of the present interactions 
between parents and their children. Secondly, current resources and 
programs which are available to help parents in the career education 
process are either insufficient or are not well enough publicized. 
School influence on career decisions' ' • 

Approximately half of^the students and parents felt 'that the school 
has had no influenfe on the* careel: decis^^s of students and 60% felt 
that the school should -be doing more in .this ariea. Part of this can be 
attributed t6 a* lack of knowledge on the part of parents of what the 
school is- presently doing. For while mqst students (73%*-75%y can name 
at, least two resources which are' provided by the sch^>/l />t community to 
aid pare'nts in helping their children in making career, decisions , more 
than half of the parents could not name a single' resource. There is. 
also evidence^ that a significant number of parents see the school and 
not themselves as the. pripiary agent in'providing career education. 
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... ? * 

These data suggest two important things for th^ school* to consider 
in reappraising' its ^career education programs. Fi^rst, in the eyes of* - 

'^the public, whom they serve, the school ic not doing sufficient work in\ 
the area»of career education. And secondly, more effective ways of 
injEprmation dissemination and parental education are needed. This is 
particularly impexftant if, as the previous data suggest, ^a decision is 
made^to help parents become ^more involved rn the career decision making 
process of their children. It is also clear that careful thought will 

-have to be given to the -potential and most apprppriate roles of both ; . 

-parents and the school in meeting careej: education goals. ^ , 



^ Summary . ^ , 

In comparing the* needs a^essment infbpnation obtained from- the 

#« ' * . 

self-developed questi^annaires with t^kt of" the published ^measure, it is 

clear that the most/meaningfiO.^ and 'useful information wai provided by 

the $elf-dfeveloped measures*.' |he r^ult^of the- published test indica- 

ting that most of- the ^tudents 'in the^'disrtrict were a|)\)ve th^ national 

ave^g^ coilld easily be /nterp.re^ed to m'^n that ^is is opt a priority 

area for additional wo'rk at the present time; The results of the self- 

developed.- ins trumentw however ,-,sag|es ted that parents* and , students *feel 

that there is an urgent need for adclitional emphasis in the area of 

* /. , • ^ * 

career education as *well as pointing out a^ n\unber of areas which should 

be conside^jred in any such development. Had the Q6eds assessmient been ^ 

limited to the use of the published instrument the district would have ' 
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• gained little useful information and may\even have arrived at incorifect 

cpdclusions . • \ ' ' » . 

r- 'r -A " . <■ ' ' 

The important point is'vnot'jjt^at published t^gjtjs are worthless. 

V, \ * * ' * ' 

Obviously, published tests have added an entire dimension to ed/cation. 

Becaujie they -are readily availafele, convenient to use and professionally ^ 

developed, published tests have allowed us to po useful and important*- 

' ^ , ^ things which otherwise wbuld_be impossible. But it is essential to 

understand that even a good published test does \not do thiags for which 

it was not designed.. Unless the purposes of the needs assessment match- ^' 

closely with what^ the test wa ^^s igned to do, the^uise of the "best" 

published test will result in information whieh is. at best, not helpful; 

and, at^worst, misleading. When this ^happens , all of the advantages, of 

published tests are of little comfo-rt to the decision maker. ' \ 

Self-developed and project tailored" needs assessment instruments 

^ ' and procedures should be used morfe frequently- in addition to or as 

replacements for published measures. All of the ^dangers in using a 

• - published measure are still present; 'but, they ara subject to greater 

control. As with published tests, self-develbped. measures need to be 

coastructed thoughtfully and careful%,, ^he questions ,they ask need to 

' match the objectives^'of tjie needs ass«asment^^and they must provide, 

1 • ■ 

information which is 'useful in making decisions. ^Obviously the con- ^ 

" m 

. struction of such measures will require time and skill. But the time is 
often not prohibitive and the .required skill fs often internally avail- 
able. * . • 
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As a needs assei^sment is designed, careful thought should 'be focused 
on the specific purposes of \the assessment and the advisability of * 
constructing instrilments tailore^^o those purposes. If this t^e of 
attention is given to the selection and development of measurement 
toolsj career edudation assessment will be enhanced and tjie goals of 
career educators, parents and students will more likely be achieved. 
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> Table 1 r * ' 

Results of the Attitudes, Section of the Career Maturity Invent ory-3Cot a 1 

Test and Selected Item Scores ' 



Total Test Scores 



New York Sample 
9th Grade' . 12th Grade 



33 



37 



Ijational Sample 
9th' Grade ' 12th Grade 



32 



34 



Selected Item Scores « 



3* I plan to follow the line of' work 
my parents suggest 

8* Work'as worthwhile mainLy- because 
it lets you buy the things 
^,JZy ypu want 

14.. Work is dull and iinpleasapt 

23- I seldom think about the job I 
want to enter * ^ 

31 . -There is only one occupation for • 
each person ' 

36. You get into an occupation iaostly 

, ■ by chance ^ 

% .\ 
46* You should, choose a job which allows 
you to do' what you believe in 

48% . I keep changing my occupational 
choice ' 



New York Sample 
9th Grade 12tli Gr^de 



% Yes 
lb 



47 

6 

22 
' 5 
' 6 
95 
28 



% Yes 

T 



40 
14 

39 

0 

7/ 
89 
30 



Because of space limitations, only, selected d^ta is (depicted here- 
Complete^ item level data can be obtained from the authors upon 
requests ^ . 
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• . ; " Table 2 

Ouestionnaire Used. with Parents in Career Edu^ltiok Needs Assessment 



How often 'do you talk with 



about ^hat s(he) Will do after 
^graduating from high school? 

' \^ ' ' ' 
Could you.eatimate how many hours 
per (week)i (month), (year)? 

a) none b) 1-5 c);6-10 d) 11-15 
e) 16 or more' . * 

2- Who usually starts the conversation? 

a) student b) Mom c) Dad ' Both 

3. Would you describe these conversa- 
tions, as: 



a) spontaneous b) nlanaed 




- for instance, does it come up around 
the dinnfer table (spontaneous) or is it 
planned in advaace? 



4- How well informed do you feel in 

talking with ^ about career » ' - 

decisions? ' ^ / 

a) yeiry well b) somewhat well informed ' ^ • 

\^ c) not very well 



5.^*"How useful would you say these 
"^'conversations are iii , helping 
make career decis'ions? 



a) very useful b) somewhat- useful . ^ 
c) not very useful • 

* (>. What does T?^^ to do following 

graduatioiv^fToir-high school? ^ 

a) work d) further schooling 

7 A How definite is his/her decision? 

. \ ' \ 

* ^ a) very definite b) somewhat definite \ 

^ c) not very definite 

. ■ / • 

8- When did s(he) make that decisioa? 

■ - \ , ■ ( - 

a) this year b) lr2 yrs ago 

c) 3-4 yrs ago d) 5+ yrs ago 

er|c • ~ rr 
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9. How much influence the school 

. (cQunselors, teachers, etc.)* had on 
's career decision? 

a) non/a . b) a little bit c) some 
d) a lot 

10. "Would you say that the amount of 

influence the school, has had has 
been: 

a) not enough b) about right c) too much 



'r 



/ 



11. Would you be interested in pairtici- *" * • ' . 

.pating if the school were to provide • • , i 

programs for aiding parents in career 

counseling? \ • . • * 

' ' ' ' I • / " 

a) yes b) maybe c) no * 

•12. How milch influence would you say that 
you (as parents) have ha(l on ' s 

* career.. decisions? 

a) none b) a little »bit ,c) some* 

i) a lot ' , ■ • ^ • 

13. Woiild you say that the" amount , o^ , ^ 

influence yoii have had. has, been: / ' 

i) not' enough' b) about right c)* too- ifluch 

14. Are you aware of any resources that 
exist in the x:ommun|.'ty and school ^ 

district to aid you and your chili^ ' *' . . , 
"iki making his/her career decision? . 

Can you name any of them?^ 

(0) '(1) ■ (2) (3) .(4) 

15. ' Have you participated in any of the , ^ . 

programs provided by the district aD,d 
community for career development? , , ^ 

f a) Yes c b) No . ' ^ 

16. How helpful did you find them for \ ^ ^ 

you and . ^ . ' ' 

a) very helpful* b) .somewhat helpful , ' ' . 

c) not very helpful* . ' * 



